United States Patent [i9] 

Karron et al. 



iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiin 

US005898793A 
[11] Patent Number: 5,898,793 
[45] Date of Patent: Apr. 27, 1999 



[54] SYSTEM AND METHOD FOR SURFACE 

RENDERING OF INTERNAL STRUCTURES 
WITHIN THE INTERIOR OF A SOLID 
OBJECT 

[76] Inventors: Daniel Karron, 333 E. 30th St., New 
York, N.Y. 10016; James Cox, 2900 
Bedford Ave., Brooklyn, N.Y. 11210; 
Bhubaneswar Mlshra, 4 Washington 
Square VUlage, New York, N.Y. 10012 

[21] Appl. No.: 08/046^45 
[22] Filed: Apr. 13, 1993 

[51] Int. CI.* G06K 9/00 

[52] U.S. CI 382/131; 382/154 

[58] Field of Search 364/413.13,413.19, 

364/413.22; 382/6, 41, 54, 128, 131, 154; 
395/119, 120, 124; 345/133, 139, 419, 
420, 424; 128/922 

[56] References Cited 

U.S. PATENT DOCUMENTS 

4,525,858 7/1985 Cline et al 382^1 

4,710,876 12/1987 Clinc et al 364/414 

4,719,585 1/1988 Cline et al 364/518 

4,729,098 3/1988 Cline et al 364/414 

4,751,643 6/1988 Lorensen et al 364/414 

4,791,567 12/1988 Clinc et al 364/413.13 

4,821,210 4/1989 Rumbaugh 364/518 

4,821,213 4/1989 Cline et al 364/522 

4,831,528 5/1989 Crawford et al 364/413.22 

4,879,668 11/1989 Cline et al 364/522 



4,885,688 12A989 aawford 364/413.22 

4,984,157 1/1991 Qioe et al 364/413.13 

5,113,357 5/1992 Johnson et al 395/124 

5,166,876 11A992 Qine et al 364/413.13 

FOREIGN PATENT DOCUMENTS 

0 463 700 1/1992 European Pat. Off G06F 15/72 

OTHER PUBUCAnONS 

"The Asymptotic Decider: Resolving the Ambiguity in 
Marching Cubes," by Gregory M. Nielson and Bernd 
Hamann, Computer Science, Arizona State University, 
Tempe, Arizona 85287-5406, pp. 83-91. 

Primary Examiner — Andrew W Johns 

Attorney, Agent, or Firm — Pennie & Edmonds LLP 

[57] ABSTRACT 

A system and method for surface rendering and tor the 
display and analysis of arbitrary structures within the inte- 
rior of a solid body is presented. The method uses as a 
starting point a voxel element which is known to be crossed 
by a surface of interest. The surface is rendered in a 
topologicaUy consistent way by connecting encountered 
surface hits at each voxel face. A pair of voxel face hits, 
surrounding a vertex value exceeding the surface value are 
used to form a triangle, spun around a third articulating point 
in the interior of the voxel. Voxel faces sharing the stirface 
hits are sequentially examined, and a set of approximation 
triangles is formed, to build a triangularization grid. The 
rendered surfaces are interactively displayed and analyzed 
for global structure properties. 

28 Claims, 20 Drawing Sheets 
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SYSTEM AND METHOD FOR SURFACE 
RENDERING OF INTERNAL STRUCTURES 
WITHIN THE INTERIOR OF A SOLID 
OBJECT 

FIELD OF THE INVENTION 

This invention generally relates to a system and method 
for surface rendering and more particularly to a system and 
method for the display and analysis of arbitrary three 
dimensional surface structures. 

BACKGROUND OF THE INVENTION 

In many practical applications it is required to obtain and 
analyze three-dimensional (3D) arrays of data representing 
one or more physical properties at regular grid positions 
within the interior of solid bodies. Typically, the data is 
obtained by methods such as computer axial tomography 
(CAT), x-ray scanning, nuclear magnetic resonance (NMR) 
imaging systems, or by other non-intrusive mechanisms 
such as ultrasound scanning, positron emission tomography 
(PET), emission computer tomography (ECT) and multuno- 
dality imaging (MMI). Each of these techniques produces a 
planar, grid-like array of values for a continuous sequence of 
planes or slices of the solid object, thus providing a three- 
dimensional array of values. A typical application is in 
medicine where the solid object can be a human body or a 
part of it and the objective is to detect and model certain 
internal structures for diagnostic and surgical planning pur- 
poses. The methods to which the present invention relates 
are, however, equally applicable to other natural or artificial 
bodies and flelck of study. 

Examples of the physical properties measured at regular 
3D positions include the coefficient of x-ray absorption in 
the CAT case or, for NMR imaging, the spin-spin or the 
spin-lattice relaxation parameters. In each case, the mea- 
sured physical values reflect variations in the composition, 
density or structural characteristics of the underlying physi- 
cal objects, providing knowledge about their internal struc- 
ture. The 3D data array typically corresponds to a plurality 
of measurements of the given physical property, taken at 
regular intervals along an appropriately selected system of 
3D (X, Y, Z) physical coordinates. Each measurement Vxvz 
of the physical property is thus associated with a specific 
array index position in a cubic lattice within the volume in 
study. Acubically adjacent set of eight such positions defines 
an unit cubic volume of the body under study and is known 
in the art as a voxel. 

It is further known in the prior art to utilize such three- 
dimensional arrays of interior physical values to generate 
visual images of the structures within the body on a display 
system. In order to display two-dimensional (2D) images of 
such 3D interior structures, however, it is necessary to locate 
the position of the surface of such structure within the array 
of physical values. This is accomplished by comparing the 
array values to a threshold value or to a range of threshold 
values which correspond to the physical property values 
normally associated with thai surface. 

For example, in the case of the human body, bones, brain 
or any other tissues can be characterized by the known range 
of their density values which is compared to the measured 
and stored 3D array values in order to separate out a surface 
model of their structure. The displayed visual images can 
next be used to assist the medical practitioner in providing 
a diagnosis or in the planning of complex surgical proce- 
dures. 

Once the location of the surface of an internal structure is 
determined, this surface is typically illuminated and shaded 
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so as to give the human eye the impression of a natural shape 
and spatial disposition of the surface when it is displayed. 
Normally, to provide such shading the angular direction of 
a vector orthogonal to the surface at each point on the 
5 surface (the surface normal) is compared to the viewing 
angle of the observer. The intensity of shading can be 
adjusted to be proportional to the difference between these 
angles. 

There are several problems associated with the surface 
jp rendering of structures in the interior of a solid body. First, 
it is necessary to accurately determine which of the voxel 
elements of the 3D array have been crossed by the surface 
of interest and at which physical location. Next, it is impor- 
tant to provide a mechanism for displaying the internal 
structure of a three-dimensional body on the two- 
dimensional computer or TV screen. Another important 
problem is that data acquired from physical data collections 
systems is often noisy and is not capable of being directly 
displayed prior to some kind of a filtering operation. 

Several solutions have been proposed in the past to 
address these problems. An approach that is frequently used 
is the one described in U.S. Pat. No. 4,710,876 to Chne et 
al. on the so-called "marching cubes". In this method, the 
surface segment intersecting a voxel is approximated by one 
2j of a limited number of standardized plane polygonal sur- 
faces intersecting the voxel. One particular standardized 
surface tiling is selected from a library of available surfaces 
by a vector which represents the binary differences between 
the threshold value for the given surface of interest and the 
eight voxel vertex values. The surface-to-voxel intersection 
coordinates, as well as the vector normal to the surface for 
each such standardized polygonal surface tiling can be 
obtained by table look-up techniques. The final surface is 
assembled as a mosaic using all the standardized triangular 

35 

The marching cubes method has found significant accep- 
tance in the industry because it is relatively simple to 
implement and is fast. Several modifications have been 
proposed since 1987. For instance, in U.S. Pat. No. 4,729, 

4Q 098 granted in March 1988 to Cline et al. a variation of the 
marching cubes methods is proposed, in which non-linear 
interpolation is used to more accurately locate the coordi- 
nates of the standardized polygons. 
Another known method for approximating the surface of 

45 an internal structure is the so-called "dividing cubes" 
method, disclosed in U.S. Pat. No. 4,719,585 to Cline et al. 
In this method, the values at the vertices of the voxel are 
used to interpolate in three dimensions values at regularly 
pcsitioned inlra-voxel sub-grid locations. The interpolated 

50 sub-grid values can then be tised to locate the surface 
position and calcuJate the normal vector more accurately. 

In order to distinguish between different internal struc- 
tures having the same or similar physical property and thus 
having close or similar values on the three-dimensional grid, 

55 U.S. Pat. No. 4,751,643 to Lorensen discloses a technique 
for labeling surfaces with similar property values and using 
adjacency criteria in respect to a "seed location" in the 
particular structure of interest to segregate the desired sur- 
face from all of the labeled surfaces. 

60 U.S. Pat. No. 4,791,567 to Chne et al. discloses another 
technique of segregating similar internal structures by deter- 
mining connectivity from adjacency information. U.S. Pat. 
No. 4,821,213 to Qine et al. discloses yet another technique 
for differentiating internal structures in which a linear path 

65 is made through the data array to locate and label all 
different structures along the scan line by counting structure 
interfaces. 
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In the methods described above, voxels within the solid 
object under study are typically traversed sequentially and 
progressively, so that every voxel within the data space is 
checked for a aossing by the surface of interest, and is 
subsequently assigned to belong either to the outside or to s 
the inside of the surface. Because of the large volumes of 
data to be processed, the methods are computationally 
intensive and relatively slow. An improvement in this 
respect is described in U.S. Pat. No. 5,166,876 to Cline, 
issued in November 1992. The disclosed method signifi- 
cantly speeds up the rendering of a surface within a bound- 
ary by only processing voxels on the surface. This approach 
saves significant computation time but still uses the same 
case table and the limited set of approximating surfaces 
which were described in the original marching cubes patent. 

As noted above, the marching cubes surface rendering 
method is widely accepted but has certain deficiencies. 
These deficiencies are generally related to the fact that the 
fifteen canonical cases used in the surface segments' 
approximation do not cover the entire spectrum of possible 
tiling combinations. This results in occasional approxima- 
tion errors, occurring at lower levels of resolution, specifi- 
cally if a voxel face is intersected by the surface twice 
resulting in four crossings ("hits") with the voxel edge. The 
errors manifest themselves in incorrect surface rendering, 
visually appearing as unexpected spots, tears and missing 
tile elements. The problems are aggravated if the collection 
data is noisy and/or with low contrast. 

A number of corrections to the marching cube algorithm 
have been offered in the past. Notable is a paper by Neilson jg 
and Hamann, "The Asymptotic Decider: Resolving the 
Ambiguity in Marching Cubes," in the Proceedings of 
Visualization 1991, pp. 83-91. This and other publications 
show that the case table approach produces inconsistent 
results in some cases. Thus, no topologically correct algo- 35 
rithm for isosurface tiling has been offered so far. 
Accordingly, reliable measurements of internal structure 
parameters, such as surface area and volume, are also not 
available. 

The display of 3D graphic images has been principally 40 
driven by the goals and directions of computer aided design 
(CAD) and computer aided manufacturing (CAM) systems. 
Systems accepting data in several basic formats have been 
developed for displaying solid bodies and manipulating 
images in various ways to create models of parts being 45 
manufactured, or internal organs being monitored. 

The present systems for surface rendering and display are, 
however, still incapable of meeting the requirements for a 
fast and truly interactive display of continuously monitored 
3D data. The complexity of the task can be better appreci- 50 
ated by noting that a typical surface rendering operation 
involves processing on the order of 512x512x512 pixels. In 
the presence of noise the task becomes even more compli- 
cated because of the necessity for additional noise Altering, 
smoothing and data interpolation, which takes processing 55 
time and often results in the loss of important structural 
details. 

It is thus desirable to provide a method for rendering 
topologically correct surface approximations of arbitrary 
internal structures within a volume of interest and a system 60 
for the display and analysis of such surface structures. It is 
also desirable to provide high quality, interactive display of 
the surface structures of interest from a set of collected data 
and minimize the effects of possible noise interference. 
Additionally, it is desirable lo provide an efficient imple- 65 
mentation of the method which facilitates the use of spe- 
cialized hardware for real time data processing. 



SUMMARY OF THE INVENTION 

Accordingly, it is an object of the present invention to 
provide a system and method for topologically correct 
surface rendering of internal structures within a volume of 
interest. 

It is another object of the present invention to provide a 
system and method for the display of three-dimensional 
information. 

It is also an object of the present invention to provide a 
system and method which can be implemented in special- 
ized electronic hardware. 

It is another object of the present invention to provide a 
graphics imaging system capable of being interactively 
used, and providing high quality images with textural shad- 
ing and other visual clues to the user. 

It is yet another object of the present invention to provide 
medical practitioners with the abihties to emulate surgical 
procedures graphically prior to undertaking invasive patient 
treatments. 

Additionally, it is an object of the present invention to 
provide a plurality of three-dimensional surface views from 
a single set of collected data. 

A further object of the present invention is to provide a 
system for analysis of internal structures within a 3D solid 
body. 

Lastly, but not exclusively it is an object of the present 
invention to minimize the effects of possible noise interfer- 
ence. ' 

In accordance with a preferred embodiment of the present 
invention, a novel method for rendering three-dimensional 
surface structures comprises the following steps. Signal 
patterns representing the value of at least one physical 
property associated with regularly spaced grid locations in a 
three dimensional body are stored in a memory means. The 
regularly spaced grid locations define voxel elements within 
the body, such that each voxel is associated with eight vertex 
values and six voxel faces. The signal patterns that represent 
values lying within a specified range associated with the 
surface structure of interest are next selected for further 
examination. 

An initial grid location which corresponds to a position 
within or on the surface structure is first selected and the 
eight vertex values associated with a voxel at the initial grid 
location are selectively retrieved. A threshold value is sup- 
plied to determine which voxel vertex values are inside and 
which voxel vertex values are outside of the surface struc- 
ture. 

For each voxel face having at least one voxel vertex inside 
and at least one voxel vertex outside of the surface structure, 
there must be at least one pair of intersects between the 
edges of the voxel face and the surface structure. The 
coordinate values of these intersects between the voxel face 
and the surface structure are then computed. Preferably, the 
computation of these intersect coordinate values is done by 
a linear interpolation of the voxel vertex values. Other 
methods of computation can similarly be used. 

A triangular approximation to the surface structure is then 
formed using the pair of intersects between the edges of the 
voxel face and the surface structure as two vertices of the 
triangle with a third vertex in the interior of the voxel. The 
step of forming triangles is repeated for each pair of voxel 
face intersects on the six faces of the voxel. The physical 
location of the third vertex of each triangle is identical and 
is computed as the centroid of all interpolated intersect 
coordinate values for the voxel. 
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The method further comprises the steps of identifying all image of the approximated surface structure. Preferably, the 

adjacent voxels sharing a face intersect with the surface surface structure is displayed by utilizing only the voxels 

structure. Next, for each identified adjacent voxel, the steps identified by the processor as being crossed by the surface 

of retrieving the eight vertex values, determining the inside structure. 

and outside vertex values, computing the coordinates of the 5 In accordance with a preferred embodiment of the present 
voxel face intersects and forming the triangles is repeatedly invention, the proposed method for 3D surface rendering is 
applied until all face-adjacent voxels within the three- implemented on a system for analysis and display of three- 
dimensional body having a face intersect with the surface dimensional surface structures which comprises the foUow- 
structure are processed. In the step of computing the inter- ing elements. First, storage means are provided for storing 
sect coordinates, only values that have not previously been 3D signal patterns representing the value of at least one 
computed are processed. physical property associated with a 3D body at regularly 

The proposed method of surface rendering further com- spaced grid locations within the body. The signal patterns 

prises the step of displaying a two-dimensional image of the are provided by a three-dimensional raw data source, such as 

approximated surface structure. Preferably, the surface MRI, CAT, x-ray, ultrasound or others. A set of 3D-adjacent 

structure is displayed by utilizing only the voxels identified grid locations define a volume element referred to as voxel 

by the processor as being crossed by the surface structure. having associated with it voxel edges and voxel faces. 

In a second preferred embodiment of the present The system also comprises means for defining a plane of 

invention, a method for generating of an internal surface pixel positions having preselected values and corresponding 

structure within a three-dimensional body comprises the to one plane of the spaced grid locations. Also provided is 

following steps. Three-dimensional signal patterns repre- means for determining in the defined pixel plane, a pixel 
senting the value of at least one physical property associated ^° associated with a voxel that is intersected by a surface 

with regularly spaced grid locations in a three dimensional structure of interest within said body, 

body are stored in memory means. The regularly spaced grid The system further comprises processing means for com- 

locations define voxel elements within the body, such that puting coordinate values of the intersection between the 

each voxel is associated with vertex locations and voxel surface structure of interest and the intersected voxel edges 

faces, each two intersecting voxel faces defining a voxel and for computing the coordinate values of at least one 

edge. Each voxel edge passes through two voxel vertices. articulating location positioned in the interior of the inter- 

The signal patterns which represent values lying within a sected voxel. Second storage means for storing the com- 

specified range associated with the surface structure of puted coordinate values along with connectivity information 

interest are next selected. Two voxel vertices of a voxel edge about joining the computed coordinate values into a set of 

for one of said stored voxels are then retrieved; and it is triangles is also provided. These triangles approximate the 

determined which voxel vertex of the selected voxel edge is intersection between the surface structure of interest and the 

inside and which voxel vertex of the selected edge is outside voxel. Each triangle has one edge on a voxel face and one 

of the surface structure. vertex at an articulating location in the interior of the 

For each selected voxel edge having at least one voxel intersected voxel. Preferably, the processor means further 

vertex inside and at least one voxel vertex outside of the comprises generating means for generating normal vectors 

surface structure, a coordinate value of a first hit location associated with the computed coordinate values. The com- 

where the surface structure crosses the voxel edge is next puted normal vectors are similarly stored in the second 

computed. Preferably, the computation of the intersect coor- storage means. 

dinate values is done by a linear interpolation of the voxel ^ In a preferred embodiment of the present invention, the 

vertex values but other computation methods can be used as processing means of the system further comprises means for 

well. identifying which of the voxels sharing a voxel face with the 

Next, each of the two intersecting voxel faces that define intersected voxel are intersected by the surface stmcture of 

the voxel edge where a hit was identified is examined for a interest. To provide for a better data management of the 

second hit location which defines an intersect between the system, the processing means further comprises means for 

surface structure and the voxel face. generating, for each voxel that is intersected, a plurality of 

For each intersect of a voxel face with the surface of index values representing information about the shared 
interest, a triangle with a vertex in the interior of the voxel voxel face intersects. These index values are also stored in 
is formed to obtain an approximation to the surface struc- the second storage means and are used to indicate to the 
ture. The location of the third vertex of each approximating 50 processor which voxels and voxel faces have been pro- 
triangle is computed as the centroid of the voxel face cessed. 

intersects such that the voxel face intersects form a closed The processing means of the system comprises means for 

contour aroimd the inside voxel vertex. simultaneously comparing all vertex values of an intersected 

The method further comprises the steps of identifying all voxel to a threshold value. This comparison is done inde- 
adjacent voxels that share a face intersect with the surface 55 pendently for each voxel face thus enabling a parallehzable, 

structure. Next, for each identified adjacent voxel, the steps high speed implementation of the proposed system, 

of selectively retrieving two voxel vertices of a voxel edge, In order to facilitate the display of the 3D surface structure 

determining the inside and outside vertex values, computing of interest, the system of the present invention further 

coordinates of the first hit locations, examining the voxel comprises display processor means which receives data 
faces defining the voxel edges, and forming the approxima- 60 from the second storage means and converts it into a display 

tion triangles are repeatedly applied until all face-adjacent format. The display format data is supplied to means for 

voxels within the three-dimensional body having a face interactively displaying surface structures of interest, 

intersect with the surface structure are processed. In the step in accordance with another embodiment of the present 

ofcompulingtheintersectcoordinates, only values that have invention, the planar arrangement of the regularly spaced 
not previously been computed are processed. 65 grid-locations is other than a rectangular array. For example. 

In accordance with the present invention, the method the planar arrangement of the grid locations may have a 

further comprises the step of displaying a two-dimensional hexagonal, or other pattern suitable for processing shape. 
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The system and method for surface rendering and display FIG. 14 shows triangle vertices drawn in a T-mesh order, 

of the present invention have a number of practical appli- piG. 15 is an approximating surface computed with full 

cations. For example, the internal data structure representa- precision. 

tion aUows the user to simultaneously process and display mG.l6 shows the approximating surface of FIG. 16 using 
two or more isosurfaces. As a result, the system provides a 5 midway hit location speed processing. 

mechanism to count 3D disjoint structures within the interior ™„ m t. ir ^ ^ i 

,,, . -u jj FIG- 17 shows tnaagle face and vertex normal vectors, 

of a body under study by enumerating the mdependent -„ .„ , ,. , . . ,. 

structures being processed. ^^'^^ 1* ^"'^ " illustrate the medical imaging surfaces 

„ , , , r , • rendered in accordance with the method of the present 

The system and method of the present invention can in invention 
addition be used to compute and display crosssections of 

disjoint surface structures. Such surface structures need not DETAILED DESCRIPTION OF THE 
only be internal structures of the object under study. While IIWENTION 
the description of the proposed method is presented in terms Referring now to FIG. 1 a surface detail is shown which 
of the measured values of a given physical property of the illustrates tiling errors in a prior art surface rendering 
object, other types of surfaces can similarly be computed 15 n,ethod. The errors are observed as bright or very dark spots 
and displayed. For instance, this can include isogradient and the surface, indicating a tear in the represented surface or 
isocurvature surfaces giving information about the locations ^ ^^^^^^ approximation tile. The present invention is 
withm the body havmg identical rate of change in the density designed to remove such errors by presenting a topologically 
values or curvature values, respectively. The cross-section of consistent method of building a triangularization grid which 
such surfaces with the structure surface can be used to M represents an arbitrary three-dimensional structure, 
automatically compute cardinal landmarks on the object illustratively, the invention is practiced on the raw data 
sur ace. obtained from non-intrusive measurements of at least one 
In a different application, the system of the present physical property within a planar slice through a body under 
invention can be used to compute global structure param- study. A typical source of the raw data is an MRI or CT 
eters such as the total surface area, and the structure volume. system, an x-ray, ultrasound or another type of a scanner, 
Information necessary to compute these quantities, includ- capable of converting measurements of some physical prop- 
ing the coordinates of a set of physical points which belong ^ny of the body, at regular grid-like locations within the 
to the suriiace is stored and available for each processed planar slice, into an array of discrete values. Other non- 
structure. The resulting parameter estimates can be used to intrusive data collection mechanisms such as positron emis- 
define characteristics of the object under study, such as sion tomography (PET), emission computer tomography 
volume occupancy, average structure size and others, which (ecT) and multimodality imaging (MMI) systems can also 
characteristics have a wide range of applications, especially 5^ usgj js a data source. 

in 3D pattern classification. jjje operation of the data source may be carried out for a 
Lastly, but not exclusively, the system of the present sequence of slices of the solid object, thus providing a 
invention can be used to observe time changes in the interior three-dimensional array of values representative of the spa- 
structures of a given solid object by knitting together "snap- tial structure of the object. Alternatively, it is possible to 
shots" of the surface of the structure and displaying these collect data over various periods of time, for the purpose of 
snap-shots in a sequence. An exemplary application of such measuring temporal changes in the body under study, 
system use is the monitoring of a patient's heart beat pattern. jhe raw data is stored in a first storage means, preferably 

BRIEF DESCRIPTION OF THE DRAWINGS '''f^'f ' ^^"^ ""'"^f ''""^e means preferably has 

a fast access time and may compnsc magnetic storage. 

These and other advantages, features and objects of the random access memory or other knovsm in the art storage 

present invention are described in the following description media. Advantageously, the storage means also comprises 
of the preferred embodiment in which: 45 means for converting the raw data into an application 

FIG. 1 is a detail of surface tiling errors in a prior art specific internal data strucmie, in order to take advantage of 

surface rendering method. specific hardware configuration used. For example, the 

FIG. 2 is a block-diagram of a system for carrying out the internal data structure provides the capability of individually 

method of the present invention. addressing and retrieving individual pixel elements as well 

„^ . , ^ ^50 as sets of spatially adjacent pixel configurations, referred to 

FIG. 3 IS an isocontour plot of an MRI axial slice of a voxels 

brain used for plane selection preview. , . .,, r j u j- . c.u 

f la accordance with a preferred embodiment of the present 

no. 4 is a three dimensional voxel with elements defined. invention, the first storage means also provides the capabil- 

FIGS. 5(A) and (B) arc perspective views of a voxel ity of indexing each vertex, each voxel edge and voxel face, 

neighborhood and voxel adjacencies for three dimensional 55 in order to facilitate the computation process. 

voxel elements, respectively. jhe indexing of the voxels wiU be better understood from 

FIG. 6 shows intersection of a voxel by surface struaures. FIGS. 4-6. FIG. 4 shows a voxel element consisting of a 

FIG. 7 illustrates voxel face hits assumptions. cubic arrangement of eight data pixels and presents element 

FIG. 8 shows ambiguity in voxel face contour lines. definitions consistently used in the following description, 
no. 9 is a flow-chart of the SpiderWeb A method. «° Eacti pixel element is associated with a triplet of indexes 

~„ in n . . • • • .• . • 1 (ijW used to determine the location of the pixel in a 

FIG. 10 illustrates spmning approximation triangles using .u j- • 1 • j • . r> .• .u 

an articulation int three-dimensional indexing system. By convention, the 

lower left vertex of the front face is selected as a reference 

RG. 11 illustrates spinning approximation triangles for a poini. The indexes of the adjacent pixels to the left, to the top 

voxel face contour ambiguity using SpiderWeb A. „ the back plane are shown to increase by the 

FIG. 12 is a flow-chart of the SpiderWeb B method. length s, which corresponds to the number of display pixels 

FIG. 13 shows a two-dimensional adaptive sampling grid. inscribed within two consecutive data points. 
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It is to be understood that FIG. 4 only serves as an web of triangles, closely approximating the surface of inter- 
illustration and other possible conventions are possible, as est. The processing sequence and visual appearance of the 
long as they consistently applied. Thus, a different vertex of rendered surface resemble the construction of spider web, 
a voxel element may be selected as a reference point, and the giving the process its "Spidcrweb" name, 
direction of index increase may be selected opposite to the 5 Some assumptions about the topology of the approxi- 
one shown in FIG. 4. Furthermore, the length s may corre- mated surfaces used in the surface rendering method of the 
spond to substantially different physical distances depending present invention are illustrated in reference to FIGS. 7 and 
on the particular application. In addition, even though in 1° f^^. 7 depicts a voxel face with vertices va-V3, edges 
FIG. 4 the length is identically labeled in aU three index E0-E3 and a clockwise scannmg direction, as mdicated by 
directions, in practice this may not necessarily hold true. The lo arrow A hn HI is shown on voxel edge El. In accor- 
reason is that the data sampling step in each coordinate ''^"^^ ^'"^ the present invention, it is first assumed thatthe 
direction depends on the corresponding spatial resolution of "^osurface of mterest is sufficiently smooth. This 
, . ... c ■ ? J- .• assumption imposes a hmitation on the surface curvature, 
the raw data source m the specific index direction. „ ,, • r ■ , , 

Secondly, an isosurtace is assumed to have no 

In accordance with the present mvention, voxel elements, singularities, breaks, or holes, so that given a hit on one 

such as the vertices, edges and voxel faces, illustrated in 15 edge, there wiU be at least one more hit on the same voxel 

FIG. 4, can be referenced by a data processor in groups or face. As a result of the these assumptions, in accordance with 

individually. Label information is associated with each the present invention hits on a voxel face must come in pairs, 

voxel element, so that vertex values connected along edges Referring back to FIG. 7, this implies that there must be at 

of the voxel, or voxel faces are marked as being connected. least one additional hit on the voxel face. If no such hit, or 

Similarly, other data structures which are used in a group 20 an odd number of hits is found, the processor will indicate 

during the processing are marked as being connected. A an error. 

second storage means associated with the data processor FIG. 8 illustrates another possible situation, when all four 

comprises a memory which is allocated for each data edges of a voxel face have isosurface hits. As shown, this is 

structure, so that the processor is capable of determining only the case when diagonally opposite voxel vertices are 

whether or not a particular element of the data structure has 25 jj^ij "insjde," or both "outside" the surface of interest, and 

been previously processed. For instance, each time a specific the two diagonal pairs are not on the same side of the 

voxel edge is retrieved, a mark is left indicating for all surface. Lacking global information about the isosurfaces, 

associated data structures that this element has been pro- the exact direction of surface intersects cannot be deter- 

cesscd. Thus, when the next element of a connected data mined. This ambiguity results in four possible cases of face 

structure is visited, the processor need not revisit the original 30 intersects, indicated as cases A, B, C and D in FIG. 8. Cases 

voxel edge. B and D will be reconsidered in connection with the Spi- 

FIG. 5(A) is a perspective view of a voxel neighborhood. derWeb A, and SpiderWeb B processing methods described 

FIG. 5(B) depicts possible combinations for voxel pairs, next. 

which define a vertex adjacency, an edge adjacency and a SniderWeb A 

face adjacency, depending on whether only a vertex, an edge ''^ 

or a voxel face, respectively, are shared. ' » flow-chart of a first embodiment of the surface 

, f , , , , ... . . rendering method in accordance with the present invention, 

In reference to FIG. 6, a voxel element is shown mter- „ j° t^ .j i .... .l j j • • 

.... . J u- referred to as SpiderWeb A. In this method, no decision 

sected by two separate isosurfaces. Voxel vertices, having .... . / .• r.v r . • .l c 

, i . _c .1. u ij . J i.- -J " about the exact direction of the face intersects in the case of 

values above an isosurface threshold are termed inside .„ r . •. • , , . „ • r-i,-. <> 

... 1 u • II .u .u ^ four hits IS made. This corresponds to case D in FIG. 8, 

vertices, while voxel vertices having values less than the , ^ l . j .u • - • ■ 

J .1. u ij . J <■ . -J .. .• TT. where the four hits are connected, thus minimizing the 

isosurface threshold are termed outside vertices. The . • j . -.l • . • 

c ■ ^ c - , . -.u 1 J • probability IS that an error IS made. The algonthmic steps in 
intersection of an isosurface of interest with a voxel edge IS 

c J. <.u... f UU-. J' .J im ii« this case are as follows, 

referred to as a hit . Six such hits, mdicated as H0-H5 are , _„„ . , 

shown in FIG, 6. The intersection between the surface of . In step 200 of the method, the pixel elements correspond- 

interest and a voxel face is referred to as a "face intersect" '"S '° one voxel are simultaneously retrieved from the data 

and. as seen in FIG. 6, connects two voxel edge hits. storage. The vertex elements of the voxel are next compared 

, , „ m step 210 to a preselected threshold which corresponds to 

As previously noted the first storage means comprises surface of interest, and each vertex is assigned as either 

rneans for converting the raw data into a specific internal j^^y^ „^ ^^^.^^ ^^^^ ^ ^^^^ ^^^^^^ 

data structure, which allows all voxel elements of the data 50 ic • . -• c ,1. -c -.u .u 1 • . 

. , ...... J 1. .1. J . c If an intersection of the surface with the voxel is not 

array to be consistently mdexed by the data processor for j . . j .u .u j j . . ■ c j- 

. , ..c .• 1 .u r • . . detected, the method proceeds to retrieve a face adjacent 

identification purposes. For example, the face intersect , . , -.i. j « j , . , 

un 1J1 .u ICC r.i. i- ri/^ r: • i. j -.u voxel in accordance With predefined voxel sequencmg rules. 

Hu-Hl on the left face of the voxel in FIG. 6 IS shared with „ . . .. ....... l ■ • 

., ,. . , r. , J • r . • .u If a surface mtersectionis detected at step 220, the locations 

the adjacent left voxel and, in fact, occupies the same r„. ... , .... , 

.. „ . • . .• J • L of all edge hits of the voxel, which have not been previously 

physical location. By using a consistent indexing scheme, as 55 . . j n r ui .u ■ c J. 

,, , . .. ■' , . ..... processed, are computed. Preferably, the position of a hit 

well known in the computer graphics art, the data processor , j • j i_ • .• ■ , • c 

, , . .1. 1 .• J .u • along an edge IS computed by using a hnear interpolation of 

need only compute the hit locations once, and use their .u 1 f.u . j c • .u j r- . 

, u ■ 11 J - J J- . the values at the two vertices defining the edge. For example, 

values when processing all corresponding edge adjacent .„ , , ... ... , . . , ° . ... 

1 J / J ■ r/Lx 001 jj J voxel edge with a hit has an outside vertex at position 

voxels, as defined in FIG. 5(o). ,, ... , j ■ -j _ . ■.■ 

' V^, with a value of Vq, and an inside vertex at position V,] 

In accordance with the present invention, the data pro- 60 ^ij, ^ ^glue of Vj, and the threshold value is x, so that 

cesser miplemente a topologically consistent method of Vo<r<Vi, the location of the edge hit Ex can be calculated 

connecting the isosurface hits on voxel edges into a con- using the formula' 
tinuous triangularization grid representing the surface of 

interest for analysis and display. The method requires a E!c-v^*(v^^-v^j>-v^tyj-v^ 

starting point, or a "seed" pixel element on a data plane, 65 Naturally, other methods of estimating the position of the 

selected by a plane selecting means. Using only local hit, such as non-linear interpolation, may be used, as is well 

information about the adjacent pixels, the method "spins" a known in the art. 
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The next step 240 involves the calculation of an Articu- 
lating Point (AP) which is located entirely in the interior of 
the voxel. The articulating point in the SpiderWeb A method 
is computed as the mean (centroid) of the system of all 
connected hits in a voxel. 

The articulating point is used in the next step 250 as the 
third vertex of a set of surface approximation triangles, each 
triangle being defined by the articulating point and each of 
the possible different pairs of the connected hits in the voxel. 

As can be appreciated by those skilled in the art, if only 
two edge hits are found for each voxel face, as for example 
shown in FIG. 6, the articulating point will lie on the plane 
defined by the hits; and the approximation triangles will be 
co-planar. An illustration of the SpiderWeb A two-face-hits 
approximation surface is shown in PIG. 10 where the 
articulating point is located near the center of the voxel at the 
centroid of the four hits and four approximation triangles are 
defined, each with the articulating point as one vertex and 
with two connected hits on one of the four faces as the other 
two vertices. 

If, on the other hand, four hits are encountered in a voxel 
face, the resulting approximation siu'face triangles will form 
a pyramid, touching at its tip (the AP) another approximation 
surface. An example is shown in FIG. 11. 

In step 260 of the method, triangle and vertex normals for 
each of the approximation triangles are computed. The 
purpose of these normals will be discussed in more detail 
below in connection with the description of display proces- 
sor 70 of the system of FIG. 2. 

In the following step 270, for each intersected voxel face, 
the face adjacent voxel is retrieved and processed. In accor- 
dance with the present invention, the indices of all voxel 
faces that have already been processed are marked so that 
processed voxel faces need not be considered again. 

Finally, data from the SpiderWeb processor is forwarded 
to storage and display at step 270. 

SpiderWeb A processing method has the disadvantage of 
creating "tunnel" voxels and "bubbles" in the case of a voxel 
face ambiguity. However, in the case of a noisy data, this 
property may actually reduce the visual impact of the noise, 
since its effect is localized to a particular voxel element and 
is not visible to the user. 

SpiderWeb B 

no. 12 is a flow-chart of the second embodiment of the 
surface rendering method in accordance with the present 
invention, referred to as SpiderWeb B. In this method, a 
consistent decision is made about the exact direction of the 
face intersects in the case of four hits on a voxel face. The 
decision corresponds to case B in FIG. 8, where the four 
edge hits are connected in a way so as to surround the inside 
voxel vertex. The algorithmic steps in this case are as 
follows. 

In step 300 of the method, a starting or seed vertex is 
selected. In the next step 310, the three edges associated with 
the seed vertex are scanned so as to retrieve the vertex 
elements at the opposite ends of those edges, and in the 
following step 320 those vertex elements are compared to 
the pre-selected threshold. The hit locations are calculated 
by means of a linear interpolation, as discussed above, or 
estimated in any other suitable manner, as known in the art. 

Triangles are formed in SpiderWeb B in the following 
four steps which are performed for each edge that is hit. 
First, in step 340, the two voxel faces that define the edge 
that has been hit are scanned for additional hits. This is done 
beginning with the inside vertex of the edge that has been hit 
and proceeding from vertex to vertex around the edges of the 
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first voxel face and then around the edges of the second 
voxel face. Hit locations are calculated by linear interpola- 
tion as discussed above. Since face intersects on a voxel face 
occur in pairs, the scanning of each face stops when the first 

s additional hit is located. The processor then forms a triangle 
having one vertex at the intersection point on the edge that 
was originally hit, a second vertex at the location of the first 
additional hit and a third vertex at an articulating point with 
an initially undetermined physical location inside the voxel. 

1" If the foregoing procedure identifies any single hits on 
another face of the voxel, that face is likewise scanned to 
locate the second hit; and the two hits on that face and an 
articulating point at an undefined location within the voxel 
constitute another surface approximation triangle. If a pair of 

15 hits are identified on another face of the voxel, these hits and 
an articulating point likewise constitute another surface 
approximation triangle. This process continues until all 
surfaces of the voxel arc accounted for. The exact location 
of the articulating point for all triangles of the voxel is then 

20 computed as the centroid of all edge hits, and information 
about the triangles is stored. Triangle and vertex normals, to 
be discussed next, are computed at step 370. 

For each voxel edge with a surface hit, the process repeats 
itself in the face adjacent voxels. In particular, in step 380 a 
set of edges from the face adjacent voxel is examined until 
all possible intersections of the isosurface of interest are 
processed. Finally, in step 390 the processor exits to storage 
means 60 and the display processor 70. 

Unlike the SpiderWeb A method, this embodiment of the 
present invention does not necessarily involve simultaneous 
processing of entire voxels. Instead, after the initial seed 
pixel is specified, the proposed method tracks along the 
isosurface of interest in accordance with the adopted index- 
ing scheme, only visiting voxel edges and faces with hits. 

Both SpiderWeb A and B processing methods reflect the 
uncertainty of the voxel face contour line ambiguity, illus- 
trated in FIG. 8. In the embodiment of the present invention, 
using SpiderWeb A, no assumption is made about the exact 

43 direction of the face intersects, resulting in a three dimen- 
sional "bubble". In the second embodiment of the present 
invention, using SpiderWeb B, a systematic choice to "sur- 
round inside vertex" is made based on physical consider- 
ations. Yet another possibility to avoid the face intersect 

45 ambiguity is to increase the resolution of the space sampling 
grid until no voxel face has four hits per face. Thus, in 
accordance with another embodiment of the present inven- 
tion the resolution of the sampling grid is adaptively refined. 
FIG. 13 shows a two-dimensional adaptive sampling in 

5Q which the upper left corner is illustratively subdivided until 
adequate resolution is achieved. 

The rectangular array of sampling elements considered 
thus far is only illustrative of the different sampling grids 
which can be used in accordance with the present invention. 

55 Well known in the literature is for instance the two- 
dimensional hexagonal sampling grid that can reduce the 
number of required samples in a plane by about 13.4% (sec, 
for example Dudgeon et al., "Multidimensional Digital 
Signal Processing," 1984, pg. 39-47). Other sampling grids 

60 can also be used, as known in the art. 

It is important to note that while the processor computes 
a large number of triangles, information for which needs to 
be stored, the actual computation process can be signifi- 
cantly sped up due to the fact that separate voxel faces can 

65 be processed independently. Thus, the proposed method can 
be implemented in a parallel architecture resulting in a 
significant improvement in terms of processing speed. 
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As shown in FIG. 2, illustrative apparatus for the practice 
of the invention comprises a first storage means 20, a plane 
selection means 30, control unit 50, a Spiderweb pnDcessor 
100, a second storage means 60, a display processor 70 and 
a structure analysis means 80. 

Plane selection means 30 operates under the control of an 
operator from control unit 50 to select data from individual 
data planes stored in data storage 20. The operator may 
preview data planes corresponding to a particular physical 
location of interest in the body under study. Since structures 
having different physical properties exhibit different ranges 
of measured values, the operator can isolate a specific 
structure of interest by selecting a particular threshold or a 
range of threshold values. For example, the operator could 
isolate bones from the surrounding soft tissue in medical 
imaging. 

FIG. 3 illustrates an isocontour plot of an MRI axial slice 
of the brain used for a plane selection preview in accordance 
with a preferred embodiment of the present invention. In this 
embodiment, using selection means 32 in FIG. 2, the opera- 
tor can choose a specific plane of interest and display it on 
a monitor. A preselect threshold value is supplied to display 
processor 70 and is used to display the locations (the contour 
lines) at which the selected data plane is crossed by a surface 
structure having the same physical property value. The 
operator can then identify a particular contour line and 
specify the coordinates of a desired starting point ("seed"). 
The coordinates of the seed are next supplied to processor 
100 to initiate the rendering of the desired surface structure. 
If no contour line of the surface of interest is identified, the 
operator can interactively specify a different data plane or 
modify the threshold value until a desirable contour is found 
and a seed element selected. 

In an alternative embodiment of the present invention, the 
selection of a starting point to render an internal surface of 
interest can be done using computer selection means 34. In 
this embodiment, a threshold value supplied by the operator 
is used in sequentially scanning the data array for elements 
that cross the threshold value. The first pixel having the same 
value as the threshold value corresponding to the surface of 
interest is selected as a starting point and its memory address 
is passed to processor 100 which generates an internal 
surface of interest. After completing the given surface, as 
indicated by absence of face-adjacent voxels that share a 
face intersect with voxels being intersected by the surface, 
processor 100 sends a signal back to selection means 34 
prompting for selection of the next starting point. Since all 
voxels visited by the processor 100 are "flagged" to indicate 
that they have been processed, selection means 34 only 
identifies the next unprocessed starting point on a surface of 
interest. Its address is passed to the processor for rendering 
the next surface structure. The process continues until no 
voxel within the stored data array having a vertex value 
corresponding to the desired threshold is left without being 
flagged as processed. This provides an indication that all 
disjoined surfaces that satisfy the threshold conditions have 
been processed. 

Storage means 60 is used by the SpiderWeb processor to 
store data about the interconnection structure of the pro- 
cessed isosurface. In accordance with the processing 
method, this may include information about the visited 
voxel vertices, edges and faces, as well as the computed 
locations of edge hits and articulating points, and informa- 
tion about the interconnection of different elements into 
individually addressable data structures, such as the approxi- 
mation triangles spun from each face intersect. Also stored 
in storage means 60 are the so-called shared normal vectors 
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associated with the articulating points and voxel edge hit 
locations. The shared normal vectors are computed in pro- 
cessor 100 as the average of the set of unit normal vectors 
for each triangle having a vertex at the respective hit or 

5 articulating point. 

The display of the generated approximation surfaces is an 
important element of the proposed invention. While both 
SpiderWeb A and B methods in general exhibit insensitivity 
to noisy data which is results in a better display, they both 

1" generate a large number of triangles, thereby increasing the 
computational burden of the system. In a number of cases, 
as discussed earlier, such triangles are in fact co-planar and 
in principle need not be processed separately. The specific 
data structtire used in the methods may, however, be used to 

15 significantly reduce the computational burden at the display 
stage. 

Reference is now made to FIG. 13 in which a "T-mesh" 
ordering of approximation surface triangles is shown. The 
T-mesh run illustrated in the figure is a contiguous strip of 
triangles, ordered in a "zig-zag" fashion. A set of three initial 
triangle vertices, labeled 0, 1, 2 is first drawn. After the last 
triangle vertex 2 is specified, the triangle 0 is drawn, using 
the connecting edges between vertices as delimiters. Since 
the edge (1-2) is shared by triangles 0 and 1, when rendering 
the latter triangle, one need only specify one more point 
(vertex 3). Thus, after vertex 3 is specified, triangle 1 can be 
drawn. In the next step, vertex 4 builds triangle 2, by only 
specifying one additional point. The process continues, until 
all triangles of the T-mesh run are drawn. At each step only 

^° one additional triangle vertex is specified and the display 
processor never needs to draw an edge twice. 

The SpiderWeb method of surface rendering results in a 
data structure especially suitable for display using the T-run 

jj approach illustrated in FIG. 13. Since iiiformation about the 
shared triangle edges is already processed and stored, the 
appropriate T-mesh sequence can correspondingly be 
defined by traversing voxel faces and considering rows of 
triangles as a group. A Silicon Graphics VGX or VTX 
hardware can be used to draw stufaces at the rate of more 
than 1.6x10* T-mesh triangles per second. 

In order to further reduce the computational requirements 
of the SpiderWeb method it is possible to simplify the 
computation of the edge hit locations. For example, if an 

45 edge has a hit, instead of calculating its location exactly, in 
one embodiment of the present invention the hit location is 
taken to a standard position (a preferred choice is midway 
between the edge vertices). The independent angles between 
surface triangles are thus reduced to a relatively small 

50 nimiber of cases, which simplifies the display at the expense 
of a somewhat "blocky" appearance of the surface. FIGS. IS 
and 16 illustrate the difference between a fiiUy processed, 
and a blocky approximation surfaces. 

Referring again to FIG. 2, the output structure of the 

55 SpiderWeb processor 100 can be described as being in a 
vector form, as a sequence of triangle vertex points. In one 
embodiment of the present invention the data supplied to 
display processor 70 comprises a list of such vectors in three 
dimensions. The list also includes the shared normal vector, 

60 associated with each triangle vertex. Such normal vectors 
are computed at steps 260 and 370 in FIGS. 9 and 12, 
respectively. In a preferred embodiment of the present 
invention, a shaded, rasterized image is produced by the 
display processor 70 and supplied to display 90, in which 

65 each triangular tile is shaded on a scale, dependent on the 
relation between the viewing angle selected from the control 
50 and the normal vector to the approximation tile. 
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Spedflcally, in order lo produce smoothly shaded images, 
the unit normal of all triangles sharing a common vertex is 
averaged together at the vertex to produce a shared, or vertex 
normal. Each triangle normal is computed as the vector cross 
product of two defining edges. FIG. 17 presents an illustra- 
tion of the concepts. The graphics processor 70 can then use 
the shared normals, to grade the calculated intensity over the 
triangle to create a smoothly shaded image having a natural 
appearance. Different coloring can also be used in the 
processor to provide better visual separation of the indi- 
vidual surface tiles, and of different objects or structures. 

Since the computation of the vertex normals in accor- 
dance with the present invention uses localized planar 
triangle information, as opposed to other known methods of 
computing surface normals which typically use the volume 
gradient case, when closely positioned isosurfaces need to 
be discriminated, the method of the present invention pro- 
vides a better surface separation. FIGS. 18 and 19 show 
examples of medical imaging surfaces, rendered in accor- 
dance with the method of the present invention. 

It is to be understood that the claimed invention is not to 
be limited to the description of the preferred embodiment 
but encompasses other modifications and alterations within 
the spirit of the inventive concept which scope is defined by 
the following claims. 

What is claimed is: 

1. A method for rendering a three-dimensional (3D) 
surface structure on a display device of a computer graphics 
display system using information from sequenced image 
slices Produced by a non-invasive data gathering device, 
comprising the steps of: 

a) generating a 3D field of data representing the values of 
at least one physical property associated with a 3D 
body by a aonintrusive cross-sectional image gathering 
device; 

b) storing the generated 3D field of data at regularly 
spaced grid locations defining voxels within said body, 
each voxel having eight vertex values and six faces; 

c) selectively retrieving the eight voxel vertex values of 
said physical property for a voxel which is intersected 
by the surface structure; 

d) determining which voxel vertex values are inside and 
which voxel vertex values are outside of the surface 
structure; 

e) computing, for each voxel face having at least one 
voxel vertex inside and at least one voxel vertex outside 
of the surface structure, coordinate values of the inter- 
sect between the voxel face and the surface structure; 

f) forming, for each intersect of a voxel face with the 
surface stmcture, a triangle having a third vertex in the 
interior of the voxel to obtain an approximation of the 
surface structure in the interior of the voxel; and 

g) generating image data associated with the formed 
triangle, said data being displayable at a display posi- 
tion corresponding to the position of the voxel on the 
surface structure. 

2. The method of claim 1 wherein step d) further com- 
prises the step of comparing each voxel vertex value with a 
predetermined threshold, the value of said threshold corre- 
sponding to the surface structure. 

3. The method of claim 2 wherein at step e) the compu- 
tation of the intersect coordinate values is done by a linear 
interpolation of the voxel vertex values. 

4. The method of claim 3 wherein at step f) the physical 
location of the third vertex of each approximating triangle is 
identical and is computed as the centroid of all interpolated 
intersect coordinate values. 
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5. The method of claim 4 further comprising the steps of: 

h) identifying each adjacent voxel, sharing a face intersect 
with the surface structure; and 

i) recursively applying steps c), d), e), f), g) and h) to each 
5 identified voxel until all face-adj acent voxels within the 

three-dimensional body having a face intersect with the 
surface structure are processed. 

6. The method of claim 5 wherein in the step of recur- 
sively computing the intersect coordinates, only coordinate 

10 values that have not previously been computed are pro- 
cessed. 

7. The method of claim 5 further comprising the step of 
displaying a two-dimensional image of the approximated 
surface structure. 

15 8. The method of claim 7 wherein the surface structure is 
displayed by utilizing only the identified voxels. 

9. A method for rendering of an internal surface structure 
within a three-dimensional (3D) body on a display device of 
a computer graphics display system using information from 

20 sequenced image slices produced by a non-invasive data 
gathering device, comprising the steps of: 

a) generating a 3D field of data representing the values of 
at least one physical property associated with the 3D 
body by a nonintrusive cross-sectional image gathering 

^5 device; 

b) storing the generated 3D field of data at regularly 
spaced grid locations defining voxels within said body, 
each voxel having associated with it vertex locations 
and voxel faces, each two intersecting voxel faces 
defining a voxel edge, said voxel edge passing through 
two voxel vertices; 

c) selectively accessing two voxel vertices of a voxel edge 
for a voxel which is intersected by the surface structure; 

d) determining which voxel vertex of the selected voxel 
edge is inside and which voxel vertex of the selected 
edge is outside of the surface structure; 

e) computing, for each selected voxel edge having at least 
one voxel vertex inside and at least one voxel vertex 

40 outside of the surface structure, a coordinate value of a 
first hit location where the surface structure crosses the 
voxel edge; 

f) examining each of the two intersecting voxel faces 
defining the selected voxel edge for a second hit 

45 location defining an intersect between the surface struc- 
ture and the voxel face, said intersect passing through 
said first and said second hit locations; 

g) forming, for each intersect of a voxel face with the 
surface of interest, a triangle with a vertex in the 

so interior of the voxel to obtain an approximation to the 
surface structure in the interior of the voxel; and 

h) generating image data associated with the formed 
triangle, said data being displayable at a display posi- 
tion corresponding to the position of the voxel on the 

55 surface structure. 

10. The method of claim 9 wherein step d) further 
comprises the step of comparing each voxel vertex value 
with a predetermined threshold, the value of said threshold 
corresponding to the surface structure. 

60 11. The method of claim 10 wherein at step e) the 
computation of the intersect coordinate values is done by a 
linear interpolation of the voxel vertex values. 

12. The method of claim 11 wherein at step f) the location 
of the third vertex of each approximating triangle is com- 

65 puted as the centroid of the interpolated intersect coordinate 
values forming a closed contour around the inside voxel 
vertex. 
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13. The method of claim 12 further comprising the steps display processor means receiving data from said second 
of: storage means and converting the received data about 

i) identifying each adjacent voxel, sharing a face intersect the set of triangles to a display format; and 

with the surface structure; and means for interactively displaying surface structures of 

j) recursively applying steps c), d), e), f), g), h) and i) to ^ interest, said means for interactively displaying being 

each identified voxel until all face-adjacent voxels driven by said display processor means, 

within the three-dimensional body having a face inter- 20. The system of claim 19 wherein said processing 

sect with the surface structure are processed. means further comprises first generating means for gener- 

14. The method of claim 13 wherein in the step of ating the unit normal vectors of each set of triangles asso- 
recursively computing the intersect coordinates, only coor- cialed with a location having computed coordinate values, 
dinate values that have not previously been computed are 21. The system of claim 20 wherein said processing 
processed. means further comprises second generating means for gen- 

15. The method of claim 13 fiirther comprising the step of era ting shared normal vectors associated with the voxel 
displaying a two-dimensional image of the approximated locations having computed coordinate values, said shared 
surface structure. normal vectors being generated on the basis of the triangle 

16. The method of claim 15 wherein the surface structure normal vectors generated by said first generating means and 
is displayed by utilizing only the generated image data said shared normal vectors being stored in said second 
associated with the formed triangles in the identified voxels. storage means. 

17. The method of claim 9 wherein the planar arrange- 22. The system of claim 21 wherein the display processor 
ment of the regularly spaced grid-locations is other than a ^° means uses said stored shared normal vectors for providing 
rectangular array. lo the display means image data which, when displayed, 

18. The method of claim 9 wherein said second hit produces different appearance of different surface structure 
location being closer to the inside voxel vertex as compared locations being displayed, said appearance being dependent 
to the outside voxel vertex of the selected edge. on said shared normal vectors. 

19. A computer graphics display system for analysis and 23. The system of claim 19 wherein the processing means 
display of three-dimensional (3D) iso-value surface struc- further comprises means for identifying which of the voxels 
tures using information obtained from sequenced image sharing a voxel face with the intersected voxel are inter- 
slices produced by a non-invasive data gathering device, sected by the surface structure of interest. 

comprising: 24. The system of claim 23 wherein the processing means 

first storage means for storing three-dimensional signal further comprises means for generating, for each voxel 

patterns representing the value of at least one physical identified as being intersected, a plurality of index values 

property associated with a three dimensional body at representing information about the voxel face intersects 

regularly spaced grid locations within said body, a shared, said plurality of index values being stored in said 

voxel being defined by a set of adjacent locations in the second storage means. 

three-dimensions spaced grid, each voxel having voxel 25. The system of claim 19 wherein the processing means 

edges and voxel faces associated with it; further comprises means for retrieving signal patterns asso- 

means for defining a plane of pixel positions having ciated with each grid location and means for providing the 

preselect position density and corresponding to one jhree-dmiensional location associated with each said gnd 

plane of said spaced grid locations; 40 °^V°Ii^ ^ , ■ . „ , 

. , , , ^ , , . , 26. The system of claim 19 wherein said processing 

means for determmmg a pixel on a plane defined by said ^^^^^ comprises means for simultaneously comparing all 

means for deflmng, said pixel being associated with a ^^^^^^ ^^^^^ intersected voxel to a value of said at 

voxel that IS intersected by a surface structure of least one physical property indicative of the surface structure 

interest withm said body; interest, the output of said means for simultaneously 

processing means for computing coordinate values of the *5 comparing being used to compute the coordinate values of 

cross-section between ihe surface structure of interest the cross-section independently for each voxel face, 

and the intersected voxel edges and for computing the 27. The system of claim 19 fiirther comprising variable 

coordinate values of at least one articulating location means for adaptively selecting the position density of the 

positioned in the interior of the inteisected voxel; pixels of said defined pixel plane. 

second storage means for storing the computed coordinate 28. The system of claim 19 further comprising structure 

values along with connectivity information about join- analysis means receiving input from said second storage 

ing ihe computed coordinate values into a set of means and capable of producing on output global structure 

triangles, each triangle having one triangle edge on a parameters, 
voxel face and one triangle vertex at an articulating 

location in the interior of the intersected voxel; ♦ ♦ « » » 



05/03/2004, EAST Version: 1.4.1 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the appHcant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR STOES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 



□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 



IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




:OLOR OR BLACK AND WHITE PHOTOGRAPHS 



